Papers with synthetic conversational data
Simple Agents, Biased Judges: Efficient Multi-Party Dialogue Generation & The Evaluation Gap (2026.acl-long)
Copied to clipboard
| Challenge: | Multiparty social dialogue is difficult to formalize and expensive to evaluate, especially at scale. |
| Approach: | They propose a lightweight and controllable multi-party dialoguegeneration framework as an experimental instrument for studying generation and evaluation in social interaction. |
| Outcome: | The proposed framework shows that human judgments against state-of-the-art LLM judges are consistent with human preferences for naturalness, engagingness, and overall quality in multi-party social dialogue. |